Integrated network for monitoring remote objects

ABSTRACT

Integrated imaging and GPS network monitors remote object movement. Browser interface displays objects and detectors. Database stores object position movement. Cameras detect objects and generate image signal. Internet provides selectable connection between system controller and various cameras according to object positions.

FIELD OF THE INVENTION

[0001] The invention relates to remote surveillance and communicationstechnology, particularly to integrated fixed and mobile networkelectronics and related software for object attribute processing.

BACKGROUND OF THE INVENTION

[0002] Remote or local object monitoring schemes have been used forvarious specific surveillance applications, such as closed-circuitsecurity video systems, as well as wireless mobile navigation systemsusing relatively near reference or distant satellite signals (e.g.,Global Positioning Satellite system (GPS)). Prior techniques and systemsfor remotely monitoring typically provide positional or visualinformation of interest about certain object context, e.g., bankfacility surveillance (see: U.S. Pat. Nos. 4,524,384, 4,511,886), ortrucking vehicle movement (see: U.S. Pat. Nos. 5,673,305, 5,223,844);however, such prior art schemes are necessarily limited to addressingeither fixed or mobile context specifically for which the particularmonitoring system has been designed originally.

[0003] Hence, there is need for more flexible and scaleable solution formonitoring and processing remote objects according to various moregeneral context and related object conditions.

SUMMARY OF THE INVENTION

[0004] The invention resides in an integrated fixed and/or wirelessnetwork and associated database and software functionality formonitoring and processing remote and/or local moveable objects.Preferably, the system implementation integrates single-chip digitalimaging camera and Global Positioning Satellite system (GPS) receiversthrough generally accessible server processors using the Internetnetwork and a software browser or functionally equivalent interfacecoupled thereto for monitoring and analyzing remote or local movement ofone or more objects.

[0005] An object database or functionally equivalent data structureprovided in digital storage and accessible to control softwaredynamically stores one or more positional and relative movement as wellas optional associated map data. Various digital cameras preferablydisposed at certain fixed and/or movable locations detect mobile objectsand generate object image signal for processing thereof as describedherein for applications.

BRIEF DESCRIPTION OF THE DRAWINGS

[0006]FIG. 1 is a general block diagram of an integrated fixed andmobile system for monitoring and analyzing remote or local object(s)according to the present invention.

[0007]FIG. 2 is a more detailed block diagram of target unit 4 of FIG. 1provided according to the present invention.

[0008]FIG. 3 is a more detailed block diagram of controller 6 of FIG. 1provided according to the present invention.

[0009]FIG. 4 is a block diagram of the general methodology of theintegrated system for monitoring remote objects according to the presentinvention.

DETAILED DESCRIPTION

[0010]FIG. 1 illustrates a general block diagram of preferred embodimentof integrated fixed and/or mobile network system or apparatus forperforming real-time, historical and/or predictive monitoring and dataprocessing of one or more remote or local objects 2. As used herein, theterm “object” is construed broadly to include any singular or multiple,wired or wireless, chattel, person, animal, or property. Furthermore,term “signal” is also construed broadly to include any electronicdigital and/or analog pulse or other recognizable or coded waveform, aswell as any digital bit stream or other processor-recognizable value,variable or data form.

[0011] For example, object may represent one or more member belonging tocommon or assigned family, classification, or other actual or virtualgrouping or enterprise. It is further contemplated that objects 2 couldinclude any moveable (e.g., pedestrian, vehicular, etc.) physical item,such as person, animal, vehicle, mobile fleet, containers, belongings,or other non-fixed chattel which may change location relative to one ormore fixed locations, such as general transit paths or other typicallynon-moving sites (e.g., hallways, roads, railway, etc.), homes, offices,schools, hotel, hospitals, warehouses, stores, etc.).

[0012] Preferred integrated network monitoring system includes one ormore central console controller or user processor 6 coupled to digitalswitch or other selectively accessible, packet and/or circuit-switchednetwork communications infrastructure 8. Network 8 may be functionalaggregate of multiple sub-networks including conventional or proprietarynetworking equipment for enabling access to and/or through the WorldWide Web (WWW), or other functionally equivalent local and/or wide areanetwork (LAN/WAN) interconnectivity.

[0013] Network 8 provides digital connection to or from any allocatedweb node address or equivalently accessible network resource, such asUniform Resource Locator (URL), associated hypertext files, and otherproper domain name and file location, according to Transmission ControlProtocol/Internet Protocol (TCP/IP) addressing scheme and properhypertext file transfer protocol (HTTP). In this way, networking isachieved via one or more network ports or other functionally equivalentservers and/or other conventional wired or wireless network accessequipment (e.g., router, modem, hub, bridge, etc.) configuredconventionally for transferring and/or transmitting data to/from and/orthrough the Internet. Such World Wide Web and Internet protocol andassociated networking and remote access standards as are specified inpublished hard-copy or online documents are hereby incorporated byreference.

[0014] As used herein, term “proprietary” pertains to knownprivately-implemented digital networking techniques, equipment, orrelated electronics and software, however, configured at least in partaccording to non-standard manner and may still be standard compliant.

[0015] Controller 6 preferably is implemented for user monitoring of oneor more objects 2 using conventional computer, workstation orfunctionally equivalent digital processing equipment and/or software.Contemplated examples of controller 6 functionality may includefollowing, if configured to operate as specified herein: NetworkComputer-type product from Oracle, WebTV-type product from Microsoft,Pilot-type product from Cisco or substantially compatible networkprocessor products thereto. Publicly accessible product functionalityand interface specifications, including hard-copy or on-line publisheddocuments therefor, for such products are hereby incorporated byreference.

[0016] Controller 6 may include one or more standard digitalmicroprocessor unit, operating system software (e.g., Windows, NT, CE,etc.), digital storage devices (e.g., disk, memory, cache, etc.),output/input devices (e.g., keyboard, monitor, mouse, microphone,speaker, camera, etc.). Furthermore, controller 6 may includeconventional network accessing interface firmware or circuit, such asEthernet card, and remote processing or network access software such asweb browser (e.g., Netscape Navigator, Microsoft Explorer, etc.),preferably using conventional or proprietary text, graphics, and othermedia format, such as Hyper Text Markup Language (HTML), ExtensibleMarkup Language (XML), JAVA, or streamed video or audio data format. Inthis configuration, real-time or stored remote and/or local access isachieved via the Internet or functionally equivalent enterprise orintranet network of object data to or from one or more target units 4,for example, in accordance with the present invention.

[0017] As shown, network 8 further couples to one or more conventionalInternet, intranet or other LAN/WAN network connection or server 5 andsensor or detector 3, as well as communicator 7 for communicating,preferably through conventional or proprietary wireless connection, toone or more target unit 4. Note that server 5 may be any electronichardware, firmware or software sufficient to couple detector 3electrically and accessibly to network 8, and that detector 3 mayprovide substantially equivalent input functionality of sensor 44 oftarget unit 4. Preferably, electronic interface coupling between server5 and network 8 provides for dynamic “hot-swap” interoperability, suchthat minimal network re-configuration and associated delay is required.

[0018] For example, server 5 may be provided as simplified electronicnetwork device having conventional processor, embedded controller, ordigital signal processor with real-time kernel or operating system,storage, Ethernet and/or modem facility, as well as electricalconnectivity to detector 3 or other appliance, such as through UniversalSerial Bus (USB), X-10, IEEE1394 (FireWire), or other conventionalelectrical signaling standard interface, which published specificationsare hereby incorporated by reference. Hence, server 5 preferablyincludes uniquely identifiable IP address or subset packet addressingscheme associated therewith; and preferably more than one detector maybe uniquely accessible, in parallel or multiplexed, by single server.

[0019] In this combined or integrated fixed and mobile networkarrangement, controller 6, which in combination with network 8,communicator 7, as well as servers 5 and corresponding detectors 3coupled thereto are located in relative fixed locations, andcommunicates with or effectively monitors through network 8. Preferablysuch arrangement uses conventional TCP/IP protocol Internet websiteaddressing scheme, one or more fixed or movable object 2. This isperformed by accessing real-time object data or other contextualinformation available or accessible via public or private IP address orother website associated with or supported by one or more detector3-server 5 coupled pair. Detector-server coupling sites are disposedwithin detecting, viewing, or other physically proximate range relativeto one or more specified object or set of objects 2.

[0020] In accordance with an important aspect of present invention,integrated network connectivity is planned such that one or moredetectors or sensors 3 are installed at preferably fixed, althoughpossibly slightly movable, physical sites or locations in deliberate anddistributed fashion. As used herein, term “fixed” is understood to meanun-movably mounted, at certain physical location or limited area,although still relocatable to other fixed sites, and still adjustable orredirectable while at such fixed site, for example, to point atdifferent direction or angular displacement. In comparison, term“mobile” is understood to mean movable or moving relative to such fixedsites.

[0021] Following are sample location categories or site classes: commonpublic or private areas including carrier transit (transport stations,bus, train, plane, ship, taxi, emergency/transport vehicles, etc.),asset storage (warehouse, library, etc.), transport paths (roads,hallways, rivers, sidewalks, etc.), general human transaction sites(stores, schools, homes, hotel, hospitals, sports locations, mobilehomes, parks, etc.).

[0022] Integrated network growth is planned according to actual oranticipated network communication traffic corresponding to particularcoupled detector-server sites, sets or geographical clusters thereof,such that locations associated with higher density of objects and/ormovement thereof are installed with additional monitoringdetector/server facilities. Accordingly, integrated system databasemaintains and updates past, current and planned location for each sensorcoupled to such system, preferably as function of time or schedule.Additionally, when existing detector and/or server site is relocated,corresponding database entries 162 are updated.

[0023] Detectors 3 may be single or multi-chip charged coupled device(CCD) and/or complementary metal oxide semiconductor (CMOS) digitalimager or video capture devices, or other functionally equivalentmonitoring apparatus for optically (e.g., black & white, color,infra-red, etc.) sensing and transmitting static and/or moving imagesignals. Preferably, detector 3 includes display indicator, such aslight-emitting diode (LED), which indicates obviously to any nearbymonitored person when such detector 3 is actively in monitoring mode, orother conventional display for indicating identity of monitoring partyname, console source or location.

[0024] Furthermore, such detectors 3 may be implemented in non-imagingphysical sensor manner, such as magnetic or smart card or reader,tactile finger-print sensor-type device, medical analog and/or digitalinstrumentation for measuring patient vitals and related records (e.g.,pacemaker operation, temperature, blood pressure, mental activity,electrocardiogram, medication level, and other similarly monitorableinformation and signals).

[0025] Alternately in facility monitoring application, detectors 3 maybe implemented to sense state and other measurement signals from motiondetector, burglar alarm, door or window open/close detector, smokedetector, thermostat, phone answering machine, or other electrical homeappliance. In certain instances, e.g., unauthorized home entry, suchsensed state may trigger other functionality, such as taking electronicphotograph and/or notifying certain entities. In this home application,such appliance may couple electrically to network 8 via server 5 orother functionally equivalent interface, for example, using standardelectrical signaling interface such as USB, IEEE1394 (FireWire), orso-called X-10 interface for communicating through standard electricallines coupled thereto.

[0026] Optionally, detectors 3 may be coupled to control mechanism foradjusting detector operation, such as focus, tilt, pan, focus, etc., aswell as means for causing multiple neighboring detectors to observe andtrack common object or object set, thereby obtaining various comparativesurveillance data. Further optionally, un-coupled or non-functional butobvious “decoy” detector/server sites may be installed at selectlocations to provide deterrent observation effect as well reduce networktraffic and overall cost. However, hidden detector/server site may beprovided to observe object activity proximate to decoy site.

[0027] In accordance with an important aspect of present invention,detectors 3 are accessible through the Internet, intranet, or otherfunctionally equivalent networking connection. In this way, currentlydetected object data signal may be obtained therefrom. Any one or moreuser with proper access capability (e.g., computer with browser,Internet access, and proper authorizations) may observe or download suchobject data information, either in multi-cast mode (i.e., multipleobserving controller users belonging to group, neighborhood or othercommon interest monitoring same detector or object or set thereof,) orpoint-to-point mode (i.e., single observing controller user monitoringone or more detector or object or set thereof). Data download may bedelivered in JAVA applet format, preferably including search-ableembedded pixel image or digital watermark, or otherwise authorized onlyto run on specified sites or processors. Preferably, each detector 3couples continuously to provide digital data stream to Internet 8generally through corresponding server 5 having identifiable IP address,packet identifier, or other network link to file or directory containingdesired monitored object data.

[0028] Moreover, accessed object data or other contextual informationmay be obtained by one or more monitoring user controller 6 throughnetwork 8 and one or more conventional or proprietary wired or wirelesscommunicator 7 coupled thereto for communicating with one or more targetunits 4 as well, preferably via public or private IP address or otherwebsite associated with or supported by one or more target unit 4located physically with or proximately observable or detectable to oneor more monitored object 2. In such distributed client-serverconfiguration including communicator 7 and one or more target unit 4, itis optionally contemplated that functionality and operation ofcontroller 6 and one or more target unit 4 may be functionallyequivalent or redundant.

[0029] In accordance with an important aspect of present invention, oneor more mobile target units 4 are provided to move with and observe anassociated object 2. Target units 4 preferably are wirelesscommunications devices which function also determine current objectlocation and movement, as well as sensed or detected condition, image,sound, etc. Accordingly, target units 4 may couple wirelessly to atleast one controller 6 through network 8, as wireless communicationservice 7 provides conventional or proprietary connectivity between theInternet and target units 4.

[0030] Hence, in this combined innovative architecture and methodology,the overall integrated system preferably includes a geographically orrelatively fixed network of multiple detectors each uniquely accessiblethrough Internet browsing interface, overlaid with a mobile set oftarget units 4 closely associated or attached to certain objects 2 forremote monitoring thereof. More accurate object monitoring is achievedby using multiple fixed detectors, especially in conjunction with mobileobject detection, motion surveillance, processing, analysis, diagnosisand/or update reporting software provided therewith. Additionally,substantially improved and low-cost surveillance scaleability andaccessibility is achieved by leveraging the Internet and/or variouscomparable networking infrastructure to provide wired and/or wirelessconnectivity.

[0031] Further, as described herein, control software 66, preferablyincluding one or more modules described hereunder and provided in wholeor in part in storage 49 for execution by processor 48 in target unit 4and/or controller 6, to enable communications 161 between such fixed andmobile components, maintain object data status and mapping information162, track and correlate movement activity from different sources 163,maintain system security and access 164, manage object-relatedelectronic transactions 165, diagnosis and analyze object performance,provide data reporting, and analyze visual object information 168.

[0032] Target units 4, shown in FIG. 4 block diagram, are disposed forrelative object 2 communications, tracking and monitoring at variousfixed or movable locations in selected topology or geography preferablyin anticipated or known paths of object 2 movement relative to fixedlocation of controller 6, network 8, communicator, server 5, or detector3. Target unit 4 may include sensor unit 44, communicator unit 46, andlocator unit 42, as well as portable power source (not shown) preferablyincluding low-power indicator. Preferably, target unit 4 usesnon-volatile memory such that digital stored data is not erased duringpower outage.

[0033] Sensor unit 44 may include one or more video cameras, activesensor, infra-red detector, microphone, or other optical, medical, orotherwise physical monitoring or observation device to provide real-timeobject data, such as audio and/or video signals, or other electronicallydetectable frequency signal, such as infra-red, or other analog ordigital electrical signal sensed from monitored object 2 depending onnature of object and kind of monitoring desired. Preferably, target unit4 input sensor 44 processes authenticated voice pattern for properrecognition and/or dialing of user instructions or other languagesyntax, but one or more microphone audio functionality may beuser-selectively de-activated for privacy or activated continuously fordetection and recording.

[0034] Communicator unit 46 is coupled to sensor unit 44 to send and/orreceive real-time or store-and-forwarded object data or packetspreferably generated by sensor 44. Processor 48 and memory 49, includingpreferably operating system and web browser software, are also providedoptionally to enable access and/or processing of data, such as real-timeobject data associated with predetermined website, IP address, orso-called Internet website hot-link or URL, as received from sensor 44and accessible via any corresponding server equipment coupled thereto.

[0035] In such self-contained processing configuration, controller 6 mayconduct real-time viewing or analysis of object data. Processor 48 isprogrammable to monitor one or more pre-configured website, i.e.,corresponding to IP address for particular object 2 observable orproximate at certain event or time window, for site hits thereto, oruser modification requests to change object observation or processing asdesired to provide remote object access and modification thereof.

[0036] In one embodiment, processor 48 monitors observed input to sensor44 for new object data and provides such data to pre-configured webpagesite. Controller 6 accesses and views such object data at correspondingsite address or URL via Internet browser tool. User instructions and/ormodifications thereto can be conveyed to target unit 4, for example, tochange, select, or adjust particular sensors 44, such as camera focus,zoom, tilt, angle, pan, etc., or other such operational attribute ofsensor device 44 of target unit 4.

[0037] Additionally, controller user may provide input to specify orrequest current or future monitoring or surveillance of one or morecertain location (i.e., associated fixed detector site) or object (i.e.,associated mobile target unit site). In this manner, software 66 isconfigured or updated via database records, object movement andobservation rules, object, target unit or controller communicationstherewith, as well as any related transaction, diagnosis, reporting andsecurity considerations appropriate to include, for recognizing orsearching one or more object, or contextual observations at detectorsites or object directories associated therewith.

[0038] Variety of remote object surveillance applications arecontemplated, such with multiple sensors 44 using video cameras situatedat regular intervals or high-traffic locations at remote sites toobserve multiple or moving objects.

[0039] In case of health care applications, such as remote medicalpatient monitoring, sensor 44 may include one or more medicalinstrumentation for observing or attachable to patient. Target trackingunit 4 preferably includes communicator unit 46 configured such thatprocessor communicates medical and/or tracking data and other data aboutmonitored object to professional medical or other care-giver disposed atcontroller 6 via communicator 7 and network 8.

[0040] In embodiment where object 2 is moveable and target unit 4 isattached to or moves correspondingly or portably with object 2, targetunit 4 includes locator unit 46. Locator 46 preferably is implementedusing general navigational functionality such as radio triangulationfunctionality relative to local radio signal sources, or GPS receiverrelative to satellite signaling sources, for determining location oftarget unit 4, and thus correspondingly of moveable object 2 physicallyassociated therewith. GPS receiver functions according to standardinternational telecommunications protocol in functional cooperation withorbiting satellite signals to calculate positional vectors, whichstandards are hereby incorporated by reference.

[0041] In this embodiment of target 4, locator 42 couples tocommunicator 46, which preferably include digital wireless transceiver,such as conventional or proprietary cellular phone-type radioconnectivity to associated radio base station representing communicator7 coupled to network 8. Hence, object 2 observation and position datafrom target unit 4 is accessible by controller 6 via network 8 andcommunicator 7.

[0042] In particular, communicator 7 wireless radio communicationfunctionality may be provided through conventional base station, networkhub or functionally equivalent network or communications equipment ofcellular phone, trunked radio, wireless local loop, and/or Internet dataservice provider. Air interface between communicators 7, 46 may complywith standard radio protocol (e.g., TDMA, CDMA, GSM, CDPD, IMT-2000,etc.), which standard documents published on-line or hard-copy arehereby incorporated by reference.

[0043] For example, cellular phone or pager functionality incommunicator 46 in target unit 4 may transmit navigational or positionsignal provided by locator functionality 42 to communicator 7 duringconventional cellular or pager roaming or signaling protocol with localradio base station or cell site to report current call or phone statusor location. In this regard, wireless communication service and Internetservice provider could be substantially same entity. Controller 6 thusreceives object and object position data via network 8 and/or viaservers 5.

[0044] Optionally, accelerometer functionality is included in locator 42to indicate object acceleration in various direction (e.g., x, y, zdirectional axes), particularly actual time and relative direction ofsuch object movement during start or stop events. Preferably,accelerometer signal or data indication of active or relative movementserves to trigger more accurate object position calculation, e.g.,supplemental to and compared with other navigational measurement such asGPS position calculation for object at certain time to verify correct ormore accurate object location. Preferably, accelerometer measurementsare initially calibrated more accurately to coordinate with such othernavigational schema.

[0045] Preferably target unit 4 is physically compact and/or ruggedportable device, appropriate for hand-held use or mounting oninstrumentation or in vehicle or automobile dashboard, and includes textmulti-media, and/or graphic display output and associated drivers 43.Internet browser software may be provided therein to allow user remotecommunication and data access to other applications and databases viathe Internet. Input functionality is provided for sensor 44, includingpossibly keypad, touch-screen, electrical signal port, etc. depending onapplication of target unit 4, such as hand-held use, or coupling tomedical instrumentation.

[0046] As described above, target unit 4 may include processor 48 andstorage 49, as well as communication device 46 having one or moreoperational modes, such as cellular phone, email, browser, fax, and/or2-way pager. Storage 49 may be implemented using digital video disk(DVD), so-called smart card format storage, or other conventional orproprietary storage or memory device.

[0047]FIG. 3 shows block diagram of controller 6. Preferably, controller6 is implemented in personal or portable computer or other conventionalprocessing platform including output device and drivers 60 (e.g.,display monitor, speaker, 3-dimensional virtual reality (VR) and/orholographic display, etc.), input device and drivers 169 (e.g.,touchscreen, keyboard, buttons, mouse, microphone, camera, etc.),microprocessor 48, and storage 49. Storage 49 may be implemented usingdigital video disk (DVD), so-called smart card format, or otherconventional storage or digital memory device.

[0048] Additionally software 66 therein includes operating system suchas preferably Microsoft Windows or other conventional operating system,Internet browser software for accessing and communicating withworld-wide web URL sites, as well as innovative instruction code and anyrelated firmware or circuitry/equipment for analyzing and/or processingdata according to preferred embodiment one or more of followingfunctional modules, as described further herein: network and datacommunications 161, object and map database structure 161, objectmovement processing 163, security management 164, electronic transactionprocessing 165, diagnosis and/or corrective tool 166, performance reportupdater 167, and visual object analyzer 168.

[0049] Such modules are generally user customizable and adaptableaccording to particular need for object surveillance. Further, suchmodules may be combined into common seamless programs or partitionedinto multiple distinct cooperating program components. Moreover, suchmodules reside actually, in whole or in part, in controller 6,associated storage peripheral device, or other processing machine orother such controller coupled thereto or accessible through network 6.Additionally, to improve program performance, one or more of suchmodules my be omitted or uninstalled from controller. Furthermore,modules in software 66 may be provided in layered or hierarchicalarrangement. In this manner, low-level core functionality is provided bydatabase structure 162, object movement module 163, visual analysismodule 168 and object diagnosis tool 166, and next-level functionalityis provided by security module 164, communication module 161,transaction module 165, and report module 167.

[0050] Preferably, browser software functions according to commerciallyavailable browser product such as, e.g., Netscape Navigator or MicrosoftExplorer, or any other functionally equivalent means for accessingInternet, intranet or other conventional or proprietary LAN/WAN website,network node or IP address.

[0051] Controller 6 or other user selection and viewing of desiredobjects 2 to be monitored are facilitated by invoking or clicking on oneor more websites, address or corresponding graphical hot-link iconsprovided or updated by target unit 4. Controller 6 access to one or moreobjects 2 may be provided indirectly through intermediate or topicalwebsite or particular page associated with one or more objects 2,associated location, object grouping, or other related object attributefor locating, searching, or otherwise monitoring certain selectobject(s) 2.

[0052] Optionally, database structure 162 in software 66 of at least onecontroller 6 provided in integrated system includes network searchable(e.g., having IP-addressable sites, links, address subsets thereof, orother deterministic network access scheme) listing or set of controllersand associated users, target units and associated objects, detectors andassociated servers. Preferably database structure is providedasynchronous storage device array format to reduce access delay thereto,including any object or set thereof description, associated movement,schedule, timing, observable images, non-image conditions, states, fees,etc. In this way, preferably Internet search ability of particularobject or object set as well as monitored information such asmulti-media images thereof are achieved, assuming proper authorizationsapply as described herein.

[0053] Database structure 162 may include schedule or other temporalscheme associated with one or more object presence, movement and/orother observed condition in one or more monitored locations. In thisway, control software 66 or user thereof may compare determined objectpresence or other surveillance measurement thereof against suchscheduled object activity. This allows determination of compliance, aswell as recording or alerting appropriately, for example, when objectdelivery is late, early, on schedule, unscheduled, or absent.Furthermore, by determining actual monitored object schedule, controlsoftware 66 may provide for more efficient local resource allocation andcoordination with such monitored object or set thereof.

[0054] Additionally, software 66 may employ one or more intelligentsoftware agents to function in conjunction with database 162,communications module 161, transaction module 165, or movement module163, as well as other modules included therein. In this manner, forexample, upon connecting controller 6 and/or mobile unit 4 to Internet8, one or more such agents may act on behalf of such controller 6,mobile unit 4, or associated object 2.

[0055] In particular, such software agent(s) effectively extendfunctional reach of various module functionality in software 66, such asby: negotiating with other software agents over network serverconnections with one or more fixed detector or server sites and/ormobile target units to schedule monitoring, collaborative chat ormeeting times; or coordinating timely delivery of product, services, orother electronic data or signaling.

[0056] Additionally, such agents may serve to retrieve (i.e., “pull” orseek specific information such as certain objects or medical patients ortheir locations, movement patterns, schedule, or other monitorableattributes), watch or “push” for specific information (e.g., appropriatemedical treatment or medication, target banner advertisements or othercommercial message or reports aligned with known or expected interestsof particular mobile objects), provide integrated system utility helpand diagnostics, or shop or prescribe for fixed products or servicesaccording to object user preference.

[0057] In this way, proper timely delivery of hazardous or perishablemobile objects, for instance, may be ensured, preferably usingcontroller system, target unit 4, or GPS receiver generated clock forproviding accurate synchronizing timing signal, and thereby minimizingpossible network signaling latency.

[0058] Visual and/or object movement data from sensor 44 includessymbolic or graphical representation of one or more monitored object 2.Such representation may include predefined or customizable avatar symbolor reduced thumbnail format, as well as relative location of eachdetector presented in topological map overlay, including positional ortemporal textual or symbolic tags or identifiers associated withparticular objects or detectors proximate thereto. For example, currentmobile unit 4 and/or associated object 2 location relative to designatedhome or base location may be illustrated against map.

[0059] Associated graphical and any corresponding textual map data mayinclude digitized cartographic, street, building, room, layout,elevation, depth, or other multidimensional map data. For example,monitored person object may be illustrated as having entered building atparticular time. Preferably, current or updated map data, including anyassociated directions, commute traffic or parking data, are downloadablefrom controller 6 or other central map data source to one or more mobiletarget unit 4 for use therein.

[0060] Preferably, input 169 is implemented using selection entryinterface functions, such as on-screen buttons for indicating userpreferences or text entry in response to various queries fromoperational control software 66. Control or performance report 167functions to generate personalized or standard on-screen, hard-copyprint-out, file storage or transfer, or other manner for deliveringanalytical, diagnostic, statistical, historical, predictive,probabilistic, or other formatted text or graphical report relating toobject monitoring operations of overall integrated system managed bycontroller 6.

[0061] Similarly to mobile target unit 4, controller 6 includes detectoror other physical or vital medical sensor interface 169,location-determining device 160, such as GPS receiver, local radiosignal triangulation functionality, or accelerometer device forgenerating actual or relative positional signal, and communicationsdevice 69, such as conventional cellular phone or pager functionality.

[0062] Additionally, such communications functions 69, 46 may includeportable local number, universal identity module, or other identifiablevalue(s) for communicating with particular authorized or associateduser. Such local portable number(s), including any prepayment creditvalue, may be stored on smart card or functionally equivalent portabledevice which is readable electronically by controller 6 or target unit4.

[0063] Preferably, communications module 161 functions adaptively toinitiate, establish, modify, and coordinate user communication ormessaging involving text, voice, video, image, or other electronicsynchronous or asynchronous signaling between controller 6 and mobiletarget unit 4, as well as any other processor or peripheral coupled tonetwork 8. Hence, polling of available objects, detectors, controllersor other networked resource in integrated system, as well as providingrecognized or unrecognized voice or video over data channel, signalingor network operation are schema contemplated within the scope ofpreferred implementation.

[0064] Additionally, communications module 161 may serve adaptively toenable scaleable collaborative or group chat communication betweenauthorized multiple entities 4,6 coupled thereto. This configuration mayarise in multi-cast mode wherein multiple observers monitor commonobject movement activity. Also, upon detection of emergency or otherurgent messages (e.g., 911 phone calls from target unit cell phones),relevant object location, movement, or other conditions are communicatedor forwarded immediately. Such messaging may be treated as high-priorityto appropriate authorities located proximately to monitored object indistress.

[0065] Object and map database structure 162 functions to determine andstore each monitored object representation, as well as prior, currentand likely future locations, for example, as provided frominitialization values, fixed detector site measurement or otherobservation signals, mobile sensor measurement or other observationsignals, console or mobile unit user entry, as well as processorcalculated, estimated or projected values. Such database information isuseful for subsequent read, write, modify, delete, restrict, or otherdata access operation.

[0066] Data structure may be implemented in one or more constituent datastructures, such as various object-oriented and/or relational datatables. Preferably, stored object data is maintained in dynamically orsimultaneously accessible and updatable database format such thatmultiple object and object related information (e.g., movement,condition, billing, etc.) may be read and processed by more than oneobject processing instance or process.

[0067] For example, monitored object data format may be providedincluding any of the following values: object name, unique objectinstance or identifier, object group or association, object interests orrequests, object physical or medical condition, object financial status,initial location and time, subsequent locations and times, system flagsor other error indications associated with object, object mobile unitidentifer, object digital image, video and/or audio information whichmay be pre-recorded or delivered from current “live” broadcast ortransmission.

[0068] Additionally, database 162 maintains associated map databasessuch that object locations may be overlaid thereon as appropriate toshow position and movement. For example, office or residential facilityfloorspace, rooms or locations are mapped to illustrate relative objectmovement therein. In particular, movement processing module 163functions programmably to track object positions and recognizepositional variances indicating relative movement, including horizontal,lateral, as well as vertical movements. Preferably, set of monitoringrules or parameters apply to restrict or expand object surveillancescope, such as specifying various allowed schedules, locations, anymonitoring or metered fee charges, monitorable objects, as well aslimiting particular data types, such as video or audio only, orrestricting access to certain sensitive medical, financial, or otherprivate observable object condition or state.

[0069] Movement processing module 163 determines when certain object(s)2 being monitored by particular detector(s) has moved or otherwiselikely to roam according to determined actual movement vector of suchobject into new detection area, unmonitored area, or overlapping areaassociated with different detector. In this manner, control software 66may recognize object movement using module 163, and thereby process 208object movement information to provide proper determination 210 and anyappropriate post-processing thereof. For example, roaming object orobject set may be handed-off to neighboring or next closest or availabledetector-server site, or potentially colliding object vectors may be sodetected and thereby avoided in time.

[0070] In accordance with an important aspect of present invention,fixed imaging array of detector sites operationally integrate withlocatable mobile units. Fixed and mobile components communicatepreferably through Internet protocol and equipment. Such integratedsystem enable flexibly scaleable approach to monitoring object movementtherein.

[0071] To achieve effective integration, movement module 163 anddatabase 162 preferably cooperate functionally to designate one or moreobject for tracking. Initially, each tracked object is staticallyrepresented in database with unique object identifier, start location,monitoring time at such location, as well as other measurable objectconditions, such as direction vector, height, etc. For each trackedobject, module 163 determines whether such object has associated targetmobile unit 4 and/or detector server site within range to observe suchobject. Mobile unit 4 may be registered in database 162 to indicateassociation with particular object. Object initial location (e.g.,Cartesian coordinates) may be compared against current list in database162 of functional detector server sites determined to be electronicallyaccessible to Internet and physically located within range to observeobject.

[0072] Continuous or dynamic streaming information about particularobject(s) may be obtained as well, for example, in live video or audiofeeds. Object designation may be invoked by user request to locateparticular object or set of objects. Initial values may beuser-specified, derived from pre-defined object movement schedule, oractually determined from integrated system field measurements (i.e.,mobile unit or detector sites). Accurate timings may be generated fromor synchronized with global clock signal available from GPS receivers.

[0073] Then, after certain time interval elapsed from initial objectmonitoring event, next object monitoring event occurs. Subsequent objectsurveillance sessions may occur according to random, regular,intermittent, or otherwise scheduled or triggered times (e.g., by mobileaccelerometer or fixed motion detector activates in response to objectmovement). Also, sessions may be repeated to provide iterativecalculations of more refined and accurate measurements of objectmovement, for example, using smaller time intervals.

[0074] So, during next event to monitor tracked objects, newmeasurements are obtained from any associated target mobile unit 4and/or detector server sites within observation range. Preferably,substantially during such monitoring event or period, mobile unit 4provides GPS location information associated with tracked object, whileobserving detectors deliver one or more image of tracked object. Suchintegrated approach provides corroborated surveillance, i.e., thattarget object is evidently observed to be located at certain location atparticular time.

[0075] Hence, during normal integrated system operation, mobile trackedobject activity traveling from one observation area to another area mayserve to trigger and cause movement module 163 to activate suchneighboring fixed detector server sites. In another case, console usermerely requests to know which objects are presently in an observablearea (i.e., query: who are all here?). In such case, fixed observationdata may serve user to trigger and cause one or more mobile unitsdisposed in such area to submit their information (e.g., associatedobject identifier, location, time, etc.) As appropriate, database 162 isupdated when certain observation detector or sensor sites are triggeredto monitor.

[0076] To increase degree of remote surveillance further, other detectoralso within observing range, but having different viewing angle, zoom,lighting, etc., may be caused to monitor target object. Other sensors inassociated mobile unit may also be caused to monitor target object inadditional ways, e.g., by activating medical instrumentation to takepatient vital measurements. Orchestration of fixed and mobileobservation measurements upon tracked object may be specified oncase-by-case basis depending on surveillance application.

[0077] For example, system flag may be issued or displayed when trackedobject is determined to be absent from scheduled location monitored bycertain detector at scheduled time. Additionally, error may be indicatedwhen same object identifier is determined to be detected at multipledifferent observation sites, but at substantially same time (since thiscondition may suggest fraudulent or pirated object or associated mobileunit). Furthermore, urgent notice may be delivered to console whenemergency is signaled from object through fixed or mobile observationchannels.

[0078] Preferably, movement module 163 continues operating to determineand update tracked object location and times, even when one or moreobservation values from various fixed or mobile detector, sensor, orlocator functionalities are temporarily disengaged or inaccessible.During such down periods, movement module 163 may use last storedinformation about particular tracked objects available in database 162,or provide extrapolated or predicted object location at future timesbased on schedule or most recent movement extrapolation (e.g., accordingto object direction, speed, etc.).

[0079] Security and access processing module 164 functions programmablyor adaptively to limit, encrypt (e.g., using public or private keyencryption scheme), or secure user access to system, particularlydatabase 162. In this way, individuals seeking to monitor certainobjects, for example, may be pre-authorized and/or authenticated usingone or more digital certificate. Such digital certificate may includeperson name, address, bank brand, timestamp, public key, and is cashedand signed by issuer digital signature. This screening method may applyto health-insured or multi-cast designated member observers or excludingun-insured or under-aged children or other vulnerable or unqualifiedgroup or objects from pre-specified monitoring or commerce transactionactivity.

[0080] Security access criteria for program rating and screening maycomply with federally or privately published standards for so-calledV-chip technology, which are hereby incorporated by reference. Inspecial or emergency circumstances, security to object database andrecorded and/or actual object surveillance and movement data may beover-ridden (i.e., trap door) to provide access to general or specificobject information.

[0081] Security and access module 164 may determine or recognizeauthorized, preferably according to location-based and/or associatedobject movement constraints, controller user or mobile object seeking tocommunicate with integrated system through authenticated sensor or inputvia acceptable voice pattern, finger-print pattern, handwrittensignature, magnetic or smart card signal, etc. For example, module 164records and issues alert when intruder target unit 4 is determined orappears to be monitoring object 2, based on geographically correlatedobject/target unit 4 movement provided to console 6, i.e., althoughunauthorized to do so.

[0082] Additionally, access to certain detectors or corresponding siteswhere current or historical access activity is relatively high, orresults in noticeable network congestion, may be limited. Purpose hereis to provide dynamic load balancing, whereby network usage iscollected, measured, analyzed, and re-allocated to different availablenetworking and detection resources.

[0083] Fraud detection feature may be included to identify, record andalert against unauthorized user, input pattern, or other predictable orunrecognizable signature or electronic behavior. Integrated systemattempted and/or successful access thereto via network ports, servers,or other access connections are logged and traceable, preferably bygeneral or specific geographic location. Furthermore, object monitoringservices are preferably restricted according to specified rules, asdescribed herein, including authorized observers, times, locations,objects, etc. Preferably, module 164 employs conventional networkfirewall protection.

[0084] Transaction processing module 165 functions preferably duringobject processing and/or diagnosis to manage user, advertiser, vendorservice billing, or other commercial transactions using integratedsystem. For example, transaction processing module 165 may initiate,activate, update, combine, separate, terminate or otherwise process useraccounts associated with one or more user controller 6 or monitoredobjects 2, or measure and/or restrict actual object 2 or controller 6usage or monitoring time, range, location or scope. This is achievedpreferably selectively according to specified billing or pricingschedule, or other rate scheme to provide regulated user charges oncredit or corporate accounts as well as location-based andtemporal-based charges. Transaction processing module 165 interactsthrough textual, graphical, sound, and/or video interface with userthrough appropriate input and/or output functionality of controller 6,and/or object 2 through target unit 4.

[0085] Moreover, transaction processing module 165 may record andanalyze actual past or current, or potential future market demand, wantsor needs according to user (user controller and/or object set)demographics, geographic location, movement pattern, preferences,consumption, transaction, or other commercial activity, behavior orinformation, particularly arising from object monitoring usingintegrated system. Hence, important objective is to providecustomer-centric electronic transaction scheme.

[0086] Optionally, transaction processing module 165 in cooperation withone or more other modules in control software suite 66, providesreal-time, dynamic, targeted and/or selective notification, delivery,advertising, educational, pricing, inventory quantity, and/or otherbusiness sales, distribution or marketing interactive or static text,graphics, voice, and/or video data information and/or associatedelectronic signaling pertaining to one or more commercially available orsoon-to-be-available product and/or service.

[0087] It is contemplated further that such solicited or unsolicitedproduct (e.g., text document, such as books, news, sports, or stockreport; graphics, such as greeting card, or other artwork; data, such asresearch databases, person or item listing, or other electronic filetransfers; sound, such as live or recorded voice or instrumental musicor newsbroadcast); or service (e.g., professional services, electronictool access, commercial transactions, etc.) may be deliveredelectronically. Such delivery could be through online Internetdistribution, publishing or access otherwise via Network 8 to usercontroller 6 or object 2, as monitored according to present invention.

[0088] Furthermore, in such operational mode, transaction processingmodule 165 may depend on known (e.g., based on reported or requestedconsumer want or need data) and/or expected (e.g., based on demographic,social, or other relational group behavior and/or predicted,extrapolated or adaptively calculated consumption pattern thereof)interest of one or more object 2 or user controller 6, within certainobservable or monitorable group or surveillance location or region. Thisapplies particularly in shopping, initiating, bidding, negotiating,accepting, modifying, or completing one or more commercial or privatetransaction, initiates or offers (i.e., unsolicitedly “pushes”)commercial information to one or more potential buyer controller 6 orobject 2; or responds or replies (i.e., solicitedly “pulls”) bydelivering commercial information to one or more potential buyercontroller 6 or object 2, or by responding appropriately thereto (e.g.,auction bid, acceptance of offer, counter-offer, request for moreproduct or service information, etc.).

[0089] Hence, in accordance with one aspect of the present invention,improved electronic commercial transaction methodology is providedgenerally such that one or more potential buyers and one or morepotential sellers (i.e., wherein any buyer or seller may correspond touser controller or target unit object having certain observable ormonitorable attributes, as described herein) communicate digitallythrough Internet or other substantially equivalent networkingfacilities.

[0090] In particular, such integrated system for enabling remote objectsurveillance-based commercial transaction is preferably achieved byconsidering potential buyer or object movement relative to fixed ormobile resources (i.e., products or services), thereby optimizinglocalized consumer satisfaction. For example, using integrated system,mobile “yellow pages” or other local vendor or available productlisting, possibly provided in local mobile or fixed “kiosk” transactionstation for obtaining certain commercial data, or actually completingtransaction, improves likelihood of matching mobile consumer wants orneeds with nearby product or service resources. In this manner, module165 may only bill customer for actual usage time or benefit derived.

[0091] Diagnosis and/or corrective-action tool 166 functions generallyto obtain and analyze integrated system status as well as objectmonitored data, particularly prior, current, and predicted objectposition, movement, image, as well as other physically sensedinformation. At any time, tool 166 may conduct network configuration andconnection test to “ping” or otherwise sense state, condition, status,location, of one or more controller, detector, server, target unit, orobject otherwise connected thereto.

[0092] Tool 166 may adaptively provide positional or directionalfunctionality generally to alert authorities or other interested partieswhen undesirable object or movement is monitored. Examples may include:when associated child, wheelchair, hiker, golfer, luggage or othervulnerable or valuable person/item object is recognized to be located,having moved, or imminently expected to move outside familiar or safelocations; or when associated delivery, transport, or emergency or otherservice vehicle object is recognized to be located, having moved, orimminently expected to move outside proper or more efficient streettrajectory, path or other preferred route.

[0093] Optionally, diagnosis tool 166 may programmably simulate expectedobject behavior. Simulation may logically, functionally or behaviorallymodel movement, or other monitored activity, based on interpolatedvalues between actual detected values, or extrapolating further movementin time, for example, according to actual historical detected values ofobject movement. In this manner, diagnosis tool 166 may include one ormore simulation models of certain object or object sets 2 usingmonitored object data from fixed and/or mobile detection sources.Depending on simulated or predictive object behavior, controller mayrecommend or take corrective action.

[0094] Additionally, in medical diagnosis context, it is contemplatedthat integrated system may be employed locally or remotely by qualifiedmedical professionals to monitor and diagnose patient vital conditionsfrom monitored signals using sensor detector 44 in mobile unit 4 coupledto controller 6 through network 8. For example, emergency medical datasuch as severity, timing, etc. may be relayed directly from mobiletarget unit 4 at crash site or ambulance to hospital emergencyfacilities.

[0095] Moreover, in commercial transaction or direct marketing context,it is contemplated that integrated system may be employed locally and/orremotely to conduct object movement-based or other monitoredattribute-based targeted product or service advertisement, offer,counter-offer, acceptance, or other communication between buyer andseller. Advertisement may be invoked electronically for on-line viewingin banner display format, preferably targeted according to known orexpected object or user demographics, behavior, or request.

[0096] Hence, when object 2 is associated with customer of certainproduct or service provided by controller 6 user associated with vendorthereof, integrated system is appropriate for providing improvedservices. Such services may include customer interaction, communication,tracking and support, for example with respect to automobiles, to notifyregularly scheduled times for car repair service or part replacementsuch as battery of object car product, or detect unscheduled objectactivity or monitored conditions, such as electronic signal indicationof flat tires, discharged emergency air bag, vehicle accident, emptyfuel gauge, exceeding certain speed limit, stolen vehicle operation(e.g., hot-wired ignition), etc.

[0097] Performance report module 167 serves programmably to define,format, and generate requested, personalized, pre-defined or otheruseful textual and/or graphical information corresponding withoperational attributes and statistics of integrated system operation.For example, as scheduled or requested, reports are provided regardingexcessive object presence or movement within particular area, objectmovement update with respect to one or more monitored patient condition,residential or commercial facilities and grounds, vehicle or transitpaths condition, goods production or inventory, etc. Hence, to improveinventory management, module 167 may provide report detailing status andcapacity for drop shipments, just-in-time inventory, from-stockinventory, etc.

[0098] Data reporting may provide real-time delivery of current objectlocation and movement relative graphically to 2 or 3 dimensional mapoverlaid thereon. Object imaging and locations from detector serversand/or sensor measurements and locations may be displayed on consolescreen as well. Emergency, error, or other system flags may beindicated.

[0099] Visual analyzer module 168 is optional and functions programmablyto process, preferably in multi-dimensions, digital image or videoinformation to attempt to recognize, store, compare, or otherwiseprocess visually observed information regarding monitored objects.Module 168 preferably serves to detect object movement or activitywithin monitoring scope of certain detector sites. This may be achievedat certain times by comparing or correlating observable similarities ordifferences between initial and subsequent surveillance data therefrom.For example, module 168 may serve object image queries and attempt torecognize, retrieve from image database, or otherwise capture image ofperson or object associated with target unit 4 determined recently tohave entered detector observation scope, or interacted with mobiletarget unit 4 sensor 44 or fixed detector 4 by communicating therewiththrough voice message, e-mail, facsimile transmission, smart-card or keyentry, finger-print tactile sensing, etc.

[0100] In FIG. 4, flow-chart shows operational steps, including initialsetup 200 of integrated system configuration (e.g., couplingcontroller(s), detector(s) and server(s) to Internet, providingidentifiable network address for each coupled detector, target unit,controller, etc.). Additionally, initial setup may include databaseinitialization, system ping test, detector polling and calibration,security access definitions or authorizations, permitted objectmonitoring rules, billing schedules, taxation rates, and object or mapdatabase definition, as specified adaptively herein for different objectclass, locations and/or times.

[0101] Preferably, network 8 connection by controller 6 to server 5 anddetector 3, or to target unit 4 through communicator 7 is substantiallycontinuous or dedicated, although may be established from time to time,for example, through conventional telephone dialup modem, IntegratedServices Digital Network (ISDN), digital subscriber Line (DSL), cablemodem, 10Base-T, or other remote access procedure to or from InternetService Provider (ISP) switch or router.

[0102] Optionally, to provide improved system reliability and faulttolerance, it is contemplated that integrated system may employredundant, mirrored, or shadowed configuration employing identicallymaintained secondary controller, including equivalent object, detector,historical, current, predictive database, conditions and state. In thismanner, when primary controller 6 somehow fails, or encounterssubstantial performance problems, secondary controller may be activatedto provide fail-safe or uninterrupted object monitoring service.

[0103] Additionally, controller 6 may serve to reduce system congestionarising from many qualified users attempting to monitor the sameobject(s). This result may be achieved particularly by limiting totalnumber of monitoring users from simultaneously accessing common websitelocation representing certain object detector locations, or by providingdistributed or shared access to common website location among multiplemonitoring users, such as in multi-cast mode.

[0104] Preferred integrated system operation and methodology achievesimproved remote object surveillance and movement tracking generally inan overlaid fixed and mobile networked infrastructure. Fixed networkincludes console units 6 connected via Internet 8 to multiple electronicdetector units 3, disposed at strategic observation sites fixed aboutscheduled or possible paths wherein mobile objects 2 may traverse fromtime to time. In this fixed arrangement, object surveillance is achievedas console accesses servers 5 coupled to one or more correspondingdetectors 3 to monitor objects 2 within observable range.

[0105] In particular, software 66 specified herein includes visualmodule 168 and movement module 163 which may provide certain objectrecognition and movement tracking thereof, such that when particularobject moves, for example, from one observation area to neighboringarea, console monitoring switches from one detector to another detectorhaving improved observation position. Additionally, in case of objectmovement over relatively longer distances, module 163 serves to trackobject progress, as well as various object condition changes, such asfuel level, health condition, cash reserves, etc.

[0106] In significant part of preferred methodology, object movementmonitoring is achieved by conducting initial surveillance of object set.Then, object is allowed time or opportunity to move, and follow-onsurveillance of such object set is conducted. Database including objectstatus and detected movement thereof provides accessible archive todetermine object movement for subsequent processing. Fixed system,however, may provide limited object surveillance and particularlymovement capability, depending on effectiveness of moving objectrecognition. Preferably, module 168 determines empirically likelihoodindication of correct/incorrect object recognition, for example,depending on historical matching database of prior similar objectsand/or conditions.

[0107] Accordingly, in part to provide improved object movementdetermination, mobile system is overlaid upon such fixed system. In thisway, each tracked object 2 is physically accompanied by target unit 4,which includes accurate location-determination facility, sensorapparatus for observing object 2, and wireless communication transceiverfor linking to network 8 and controller 6 through fixed communicator 7coupled thereto. In this mobile subsystem overlay, remote objectsurveillance and movement are significantly enhanced by allowing console6 to determine more definitively from target unit 4 identity, location,and other physically measurable condition of associated object 2.

[0108] More particularly, in accordance with an important aspect of thepresent invention, console 6 may coordinate remote observation activityat targeted sites. Coordination is done by selecting more accuratelyproximate detector-server nodes to track mobile objects 2 according tocorresponding object location delivered by associated target unit 4 toconsole 6. Hence, in integrated fashion, console user leverages existingglobal Internet connectivity as well as geographically distributeddetector and server set coupled thereto. Also, wireless mobileflexibility is provided by properly equipped target units attached orincluded physically with certain monitored objects.

[0109] Firstly, based on various initializing factors for determiningobject location or surveillance, such as initial polling results fromone or more target units 4 or detectors 3, retrieved object siteinformation, object movement search results, or initial, preferablyauthorized, detected observations or other monitoring surveillance 202performed on subject object(s), initial positioning or surveillance forone or more object may be determined. Such initial information may bedisplayed graphically preferably relative to corresponding map data,based on electronically observed measurements, data, signals, orpre-defined object context or related values, relative to map databaseor other comparable contextual database.

[0110] Monitored object set may also be defined according touser-requested search terms for finding and/or prioritizing relevance ofspecific or qualified object members of particular class or othersearchable attribute, e.g., find all doctors in “94062” zip code area,or find “Elsa” the dog (who may be wearing a trackable target unit ondog collar). According to preferred methodology, object monitoring maybe invoked by causing controller browser to initiate session call foraccessing website address associated with server-detector associatedwith particular object.

[0111] Preferably, database 162 maintains one or more objectrepresentation. instance, state, condition, movement, and/or otherassociated monitored information, such that at any particular moment,multiple objects 2 may be monitored and processed effectively inparallel according to operational steps of FIG. 4.

[0112] Monitored object set may be assigned expected time, location, orother physical conditions, such as medical state, each assigned value orsubstantially similar value within allowable range, say +/−15%variation. In this case, initial values or conditions may be set inintegrated system, such that proper values are monitored accordingly,for instance, activating video detector(s) located most closely toparticular monitored object.

[0113] Next, object movement or transition may occur 204 after or duringa specified time period, which may be regular, random, triggered, orpre-scheduled. During such temporal period, object physical state, suchas location, vehicle, luggage, patient, nanny, bank teller, vehicletraffic, or prisoner condition may change. As appropriate, GPS receiverin mobile unit 4 may provide universal clock signal source forrelatively accurate synchronization within integrated system.

[0114] Then, based on secondary authorized and detected observations ormonitoring surveillance 206 performed on subject object, or secondarypolling results therefrom, secondary position or condition isdetermined. Preferably, integrated network configuration determinationor ping test upon one or more associated controller, server, detector,or object coupled thereto is conducted to recognize current networkparticipants and corresponding configuration, conditions or states.Hence, when such testing reveals defective or unresponsive detector orserver site, then such site is deactivated and removed from activedatabase, until problem is resolved.

[0115] In accordance with an important aspect of present invention,integrated approach combining positional data (e.g., processed GPS orother triangulated radio signals) and visual data (e.g., observedreal-time video or other digital image), or other physical sensory data(e.g., patient medical vitals) are obtained. Such data are obtainable byset of fixed or relatively fixed (e.g., video cameras) or mobile (e.g.,GPS receivers) disposed at various locations about monitored objectpresence and activities. Such integrated network of sensory andpositional detectors may be arranged along streets, highways, bridges,intersections, elevators, buildings, restrooms, classrooms, hotel,offices, hospitals, prisons, storage warehouses, churches, stores, andvirtually any other practical location of monitorable human or animalactivity.

[0116] To address potential individual privacy sensitivity or objectionto being monitored, certain locations may be omitted from detection, orrequire approval prior to or while being monitored. Additionally,monitored object(s) may be provided current list of monitoring usersource names, class or total number.

[0117] Next, object analysis and movement processing is performed and/orgraphically displayed 208. Here, relative movement, acceleration orother object physical condition shift or other detected transformationis accomplished when spatial or other physical variance betweentemporally spaced measurements is detected and accordingly shownon-screen preferably animating object movement against relative mapdata. Preferably, object recognition and condition monitoring, includingany monitored changes thereto, are achieved. Such object processing isachieved via visual, video, or image processing, as described herein foroptional module 168, to recognize or correlate particular observableobject attributes, and/or by GPS or other radio triangulation positionalsignal information and any corresponding sensed object identifier orsignature information, as determined over different or scheduledmonitoring times. Preferably, any substantial difference of measuredlocation values are reconciled in favor of GPS location calculation overother position or navigation scheme, particularly when selectiveavailability (SA) thereto is set substantially to zero.

[0118] Object movement relative to appropriate map overlay may beillustrated, for example, in two or three dimensions statically ordynamically. In this way, each object instance may be symbolicallyrepresented by reduced-size or thumbnail graphical or textual icon oravatar on output display.

[0119] Then, object movement diagnosis, corrective-action, ortransaction processing is performed 210. In this regard, data processingmay be case- or application-specific as described herein to the extentthat user or object condition changes warrant case-specific diagnosis,correction, remote repair, or transaction services.

[0120] In accordance, with one aspect of present invention, improvedmethodology and system are provided to determine remote and/or localmobile object movement. Such movement is based on monitored or detecteddata from one or more fixed detectors coupled to Internet or othernetworking interconnection. Further, such movement determination isemployed in subsequent process activity, such as targeted commercialtransaction, remote health care, public or private facility, goods,mobile, or staff surveillance.

[0121] For example, upon indication by mobile target unit 4 of low-powersource condition, integrated system facilitates via module 210 sleepmode operation and/or provisions for localized power supply bycontroller 6 notifying particular target unit 4 with low power sourcevia network 8 and communicator 7 wireless connection of convenient ornearby re-charge outlet or battery inventory.

[0122] Finally, as shown, performance report may be generated and/ordelivered preferably according to schedule or request as well astargeted delivery site according to requester or object locale. Ongoingconsole display of monitored objects, movement, maps, flags, etc. may beprovided. Then, database is updated accordingly 212, for example, whenexcessive or unscheduled object presence or movement is detected. Asappropriate, steps are repeated 213, or adapted according to any revisedinitialization values, to accommodate further object movement.Optionally, software 66 may employ neural-based or adaptive learning forhigh-transaction processing for tracking real-time data associated withmultiple object surveillances and/or movements.

[0123] Therefore, to summarize key features of inventive methodology andsystem, following general steps are provided in brief sequential formatas implemented in preferred solution:

[0124] 1. Integrated Overlay.

[0125] Provide integrated surveillance and communication system, whereinmobile units are overlaid with fixed detector network. Both fixed andmobile units are accessible through the Internet.

[0126] 2. Fixed Detection.

[0127] Console user monitors object movement through multiple cameradetectors coupled through the Internet.

[0128] 3. Mobile Detection.

[0129] Console user monitors object movement through mobile unit sensorsand locators coupled wirelessly through the Internet.

[0130] 4. Object Analysis.

[0131] Control database and software combines fixed and mobile objectdata to monitor object movement relative to fixed surveillance sites.Fixed detectors observe object presence within certain area, whilemobile sensor provide more accurate location as well as object sensordata. Database tracks historical, current, and predicted movement ofobject sets, thereby facilitating object search.

[0132] 5. Processing Services.

[0133] Commercial transactions deliver products and services moreeffectively to mobile object consumers. Secured access and graphical mapoutputs enhance system usefulness.

[0134] Although the principles of this invention has been illustrated inthe preferred embodiment in accordance to a surveillance application, itis intended that the principles of this invention to be also applied toother applications, such as patient monitoring, person, vehicle, orproperty tracking and monitoring.

[0135] Thus, the foregoing described embodiments of the invention areprovided as an illustration and description. It is not intended to limitthe invention to the precise form described. Other variations andembodiments are possible in light of the above teaching, and it is thusintended that the scope of the invention be limited by the detaileddescription, but rather by the claims as follow.

We claim:
 1. An integrated system for electronically monitoring remoteobjects comprising: a controller for monitoring one or more moveableobjects; a plurality of detectors for detecting one or more objectsmonitorable by the controller; and a digital network for selectivelyinterconnecting the controller to one or more detectors.
 2. The systemof claim 1 wherein: the controller comprises a database comprising arepresentation of each monitorable object, each object representationhaving a position relative to one or more detector.
 3. The system ofclaim 2 wherein: at least one of the detectors comprises a camera forgenerating a digitized image signal of a monitored object disposedrelative to such camera, the controller receiving the digitized imagesignal to monitor such object.
 4. The system of claim 2 wherein: thecontroller further comprises software means for detecting movement ofone or more monitored object and modifying the object representation ofeach object detected to move in the database to indicate an updatedposition.
 5. The system of claim 2 wherein: the controller furthercomprises a browser interface for graphically displaying at least onemonitored object relative to one or more detector, the digital networkcomprising an Internet network infrastructure.
 6. The system of claim 1further comprising: at least one moveable unit corresponding to at leastone monitored object, each moveable unit comprising means fordetermining a position of such moveable unit, each moveable unit coupledto the digital network, such that the determined position is accessibleby the controller.
 7. An integrated system for real-time monitoring ofone or more remote objects comprising: a target unit in proximity to oneor more remote objects, the target unit comprising a sensor unit, and acommunication unit, including at least a processor and an Internetaccess application, a controller comprising a browser software interfacefor accessing a website comprising remote real-time object dataassociated with the remote object and displaying the remote object dataon a screen, a database comprising a representation of each monitoredobject, and software means for detecting movement of one or moremonitored object and modifying the object representation of each objectmovement to indicate an updated position in the database; a plurality ofcamera detectors for detecting one or more objects monitored by thecontroller, and generating a digitized image signal of the monitoredobject disposed relative to the camera, the controller receiving thedigitized image signal to monitor such object; and a digital Internetnetwork for selectively interconnecting the controller to one or morecamera detectors.
 8. An integrated system for electronically monitoringremote objects comprising: a controller comprising a browser softwareinterface for monitoring one or more moveable objects and graphicallydisplaying at least one monitored object, a database comprising arepresentation of each monitored object, and software means fordetecting movement of one or more monitored object and modifying theobject representation of each object movement to indicate an updatedposition in the database; a plurality of camera detectors for detectingone or more objects monitored by the controller, and generating adigitized image signal of the monitored object disposed relative to thecamera, the controller receiving the digitized image signal to monitorsuch object; and a digital Internet network for selectivelyinterconnecting the controller to one or more camera detectors.
 9. Thesystem of claim 8 further comprising: at least one moveable unitcorresponding to at least one monitored object, each moveable unitcomprising a Global Positioning Satellite (GPS) receiver for determininga position of such moveable unit, each moveable unit coupled to thedigital Internet network, such that the determined position isaccessible by the controller.
 10. In a network comprising a controllercoupled to a plurality of detectors, a method for electronicallymonitoring remote objects, the method comprising the steps of:monitoring remotely over an Internet connection by a controller one ormore moveable objects detected by one or more detectors; maintaining adatabase comprising a representation of each monitored object; detectinga movement of one or more monitored object; and modifying in thedatabase the object representation of each object movement to indicatean updated position.
 11. The method of claim 10 further comprising thesteps of: determining by a moveable unit corresponding to at least onemonitored object, the moveable unit comprising a Global PositioningSatellite (GPS) receiver accessible to the controller, a position ofsuch moveable unit; and communicating the moveable unit position to thecontroller.
 12. In an integrated digital monitoring system comprising afixed network including a controller and a plurality of detectors, and amobile network including a plurality of mobile sensors associated with aplurality of mobile objects, such sensors and detectors coupled to theInternet, a method for object surveillance comprising the steps of:receiving from at least one detector of the fixed network a first signalfor monitoring an object associated therewith; receiving from at leastone sensor of the mobile network a second signal for monitoring theassociated object; determining a location of the associated objectaccording to the first signal or the second signal; and storing in adatabase the location of the associated object.
 13. The method of claim12 further comprising the steps of: selecting a local product sourcerelatively proximate to the object location; and sending an indicationof the selected product source through at least part of the mobilenetwork for consideration by the object.
 14. The method of claim 12further comprising the steps of: receiving from at least one detector ofthe fixed network a third signal for monitoring the object associatedtherewith; receiving from at least one sensor of the mobile network afourth signal for monitoring the associated object; determining achanged location of the associated object according to the third signalor the fourth signal; and storing in the database the changed locationof the associated object.
 15. The method of claim 12 further comprisingthe steps of: providing a map including the object location; anddisplaying the map and the object location included therein.
 16. In aconsole processing unit coupled via the Internet to at least one fixeddetector and at least one mobile sensor, a data structure forrepresenting a monitored object, the data structure comprising: anobject identifier; a first object location and a time monitored at suchlocation, provided by a detector coupled to the console processing unit;and a second object location and a time monitored at such location,provided by a sensor coupled to the console processing unit.
 17. Thedata structure of claim 16 further comprising: a scheduled objectlocation and a time scheduled for such location.
 18. In anInternet-coupled network for electronically linking at least one fixedvendor processor to at least one mobile buyer processor, a method fortransacting between vendor and buyer processors, the method comprisingthe steps of: determining a first location of a mobile buyer processorcoupled to the Internet; receiving from the mobile buyer processor afirst transaction message; and sending to the mobile buyer processor asecond transaction message indicating a first fixed vendor processorproximately disposed to the first location.
 19. The method of claim 18further comprising the steps of: determining a second location of themobile buyer processor; receiving from the mobile buyer processor athird transaction message; and sending to the mobile buyer processor afourth transaction message indicating a second fixed vendor processorproximately disposed to the second location.
 20. Integratedtele-medicine system using fixed and mobile processor communication forenabling remote medical care, the system comprising: a care-giverprocessor coupled to a packet-switched digital network, the care-giverprocessor accessing a database including a representation of an identityand a location of at least one remote patient; a mobile communicationsunit physically associated with a remote patient for monitoring at leastone medical vital sign of such remote patient, the mobile communicationsunit communicating such monitored vital sign to the care-giver processorthrough the digital network; and a first detector coupled to the digitalnetwork and selected by the care-giver processor for observing theremote patient when such remote patient is determined by the care-giverprocessor to be located within a first observation range of the selectedfirst detector.
 21. The system of claim 20 further comprising: a seconddetector coupled to the digital network and selected by the care-giverprocessor for observing the remote patient when such remote patient isdetermined by the care-giver processor to have moved and subsequentlylocated within a second observation range of the selected seconddetector.